Apparatus and method for providing additional information for each region of interest

ABSTRACT

An apparatus and method for providing additional information for region of interest. The apparatus includes a region of interest extractor configured to extract regions of interest from a first medical image and at least one second medical image,a region of interest merger configured to merge a region of interest of the at least one second medical image into the first medical image, an additional information determiner configured to determine additional information required for each region of interest, and an additional information provider configured to provide the determined additional information for the each region of interest.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application is a continuation application of prior application No.14/700,338, filed on Apr. 30, 2015, which claimed the benefit under 35U.S.C. § 119(a) of Korean Patent Application No. 10-2014-0052823, filedon Apr. 30, 2014, in the Korean Intellectual Property Office, the entiredisclosure of which is incorporated herein by reference for allpurposes.

BACKGROUND Field

The following description relates to an apparatus and method forproviding additional information for each region of interest.

Description of Related Art

Recently, various medical imaging devices, such as, for example,ultrasonic imaging device, an X-ray imaging device, a magnetic resonanceimaging (MRI) device, a computed tomography (CT) device, a positronemission tomography (PET) device, have been used to diagnose diseases.

Sometimes physicians may diagnose diseases using a single-modalityimages, but in most cases, it is difficult to accurately diagnosediseases using the single-modality images. Accordingly, doctorsgenerally diagnose diseases by integrating different modality images.

In these cases, it takes longer for doctors to diagnose diseases, sincethey have to read whole modality images by viewing them one afteranother.

SUMMARY

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intended tobe used as an aid in determining the scope of the claimed subjectmatter.

Disclosed is an apparatus and method for providing additionalinformation for each region of interest.

In one general aspect, there is provided an apparatus for providingadditional information for regions of interest, the apparatus includinga region of interest extractor configured to extract regions of interestfrom a first medical image and at least one second medical image, aregion of interest merger configured to merge a region of interest ofthe at least one second medical image into the first medical image, anadditional information determiner configured to determine additionalinformation required for each region of interest, and an additionalinformation provider configured to provide the determined additionalinformation for the each region of interest.

The at least one second medical image may be an image captured prior tothe first image.

The region of interest merger may be further configured to register thefirst medical image and the at least one second medical image.

The additional information determiner may include a rule storageconfigured to store at least one rule that defines feature values ofregions of interest and additional information required for the featurevalues, a feature value extractor configured to extract feature valuesfor each of the merged regions of interest, a rule retriever configuredto retrieve rules for the extracted feature values from the rulestorage, and an additional information selector configured to selectadditional information for each of the regions of interest based on theretrieved rules.

The additional information comprises new additional information thatrefers to information associated with examinations to be conducted foran accurate diagnosis, and previous additional information that refersto examination-related information stored in a medical database to beadditionally provided for an accurate diagnosis.

The apparatus may include an additional information acquirer configuredto acquire additional information required for the each region ofinterest.

The additional information for the each region of interest may beretrieved from a medical database.

The apparatus may be installed in an ultrasonic imaging devicecomprising at least two imaging modes selected from a bloodstreamimaging mode for obtaining a bloodstream image, an elastography mode forobtaining an elastography image, a general ultrasonic mode for obtaininga general ultrasonic mode, and a high-resolution ultrasonic mode forobtaining a high-resolution ultrasonic image.

The additional information acquirer may be further configured to acquirethe additional information for each of the regions of interest bychanging an imaging mode of the ultrasonic imaging device based on thedetermined additional information.

The additional information provider may be further configured to providea user with additional information acquired for the each region ofinterest.

The at least one second medical image includes an image of a portionidentical to a portion captured by the first image.

The first medical image and the at least one second medical image may beacquired from a medical database.

The feature values may include features of the regions of interest.

The feature value extractor may be further configured to extract thefeature values based on analyzing information on each of the mergedregions of interest stored in a medical database.

In another general aspect, there is provided a method for providingadditional information for region of interest, the method includingextracting regions of interest from each of a first medical image and atleast one second medical image, merging a region of interest of the atleast one second medical image into the first medical image, determiningadditional information required for each of the merged regions ofinterest, and providing determined additional information for the eachof the regions of interest.

The at least one second medical image may be a medical image capturedbefore the first medical image.

The merging may include registering the first medical image and the atleast one second medical image.

The determining may include extracting feature values of each of themerged regions of interest by analyzing information on the mergedregions of interest stored in a medical database, retrieving one rulefor the extracted feature values from one or more pre-stored rules, andselecting additional information for each of the regions of interestaccording to the retrieved rule.

The determining may include extracting feature values of each of themerged regions of interest by analyzing information on the mergedregions of interest stored in a medical database, retrieving one rulefor the extracted feature values from one or more pre-stored rules, andselecting additional information for each of the regions of interestaccording to the retrieved rule.

The additional information may include new additional information thatrefers to information associated with examinations to be conducted foran accurate diagnosis, and previous additional information that refersto examination-related information stored in a medical database to beadditionally provided for an accurate diagnosis.

The method may include acquiring additional information for the each ofthe regions of interest based on the determination results.

The acquiring of the additional information may include acquiringadditional information for each of the regions of interest from amedical database.

The providing comprises providing a user with the additional informationfor each of the regions of interest.

Other features and aspects will be apparent from the following detaileddescription, the drawings, and the claims.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram illustrating an example of an apparatus forproviding additional information for each region of interest.

FIG. 2 is a diagram illustrating an example of an additional informationdeterminer 130.

FIG. 3 is a diagram illustrating another example of an apparatus forproviding additional information for each region of interest.

FIG. 4A is a diagram illustrating an example of extracting regions ofinterest from a first medical image and a second medical image.

FIG. 4B is a diagram illustrating an example of merging regions ofinterest of second medical images into a first medical image.

FIG. 4C is a diagram illustrating an example of additional informationnecessary for each region of interest.

FIG. 5 is a diagram illustrating an example of providing a user withadditional information necessary for each region of interest.

FIG. 6 is a diagram illustrating an example of a method for providingadditional information for each region of interest.

FIG. 7 is a diagram illustrating an example of determining additionalinformation necessary for each region of interest.

Throughout the drawings and the detailed description, unless otherwisedescribed, the same drawing reference numerals will be understood torefer to the same elements, features, and structures. The drawings maynot be to scale, and the relative size and depiction of these elementsmay be exaggerated for clarity, illustration, and convenience.

DETAILED DESCRIPTION

The following detailed description is provided to assist the reader ingaining a comprehensive understanding of the methods, apparatuses,and/or systems described herein. However, various changes,modifications, and equivalents of the systems, apparatuses, and/ormethods described herein will be apparent to one of ordinary skill inthe art. The progression of processing steps and/or operations describedis an example; however, the sequence of and/or operations is not limitedto that set forth herein and may be changed as is known in the art, withthe exception of steps and/or operations necessarily occurring in acertain order. Also, descriptions of functions and constructions thatare well known to one of ordinary skill in the art may be omitted forincreased clarity and conciseness.

The features described herein may be embodied in different forms, andare not to be construed as being limited to the examples describedherein. Rather, the examples described herein have been provided so thatthis disclosure will be thorough and complete, and will convey the fullscope of the disclosure to one of ordinary skill in the art.

FIG. 1 is a diagram illustrating an example of an apparatus forproviding additional information for each region of interest. Based onfeatures of each region of interest, an apparatus 100 for providingadditional information for each region of interest determines whatadditional information is needed in medical images for each region ofinterest to accurately identify each region of interest for diagnosis ofdiseases, and to provide a user with sufficient information associatedwith each region of interest. The apparatus 100 for providing additionalinformation for each region of interest may be installed in a medicalimaging device.

An example of the apparatus 100 for providing additional information foreach region of interest is installed in an ultrasonic imaging device.The ultrasonic imaging device includes various imaging modes, such as,for example, a bloodstream imaging mode for obtaining bloodstreamimages, an elastography mode for obtaining elastography images, ageneral ultrasonic mode for obtaining general ultrasonic images, and ahigh-resolution ultrasonic imaging mode for obtaining high-resolutionultrasonic images. The apparatus 100 for providing additionalinformation for each region of interest may be installed in variousother diagnostic imaging devices without departing from the spirit andscope of the illustrative examples described.

Referring to FIG. 1, the apparatus 100 for providing additionalinformation for each region of interest includes a region of interestextractor 110, a region of interest integrator 120, an additionalinformation determiner 130, an additional information provider 140, anda display 150.

The region of interest extractor 110 may extract a region of interestfrom each of a first medical image and second medical images.

For example, the region of interest extractor 110 may extract a regionof interest from a medical image by applying an algorithm forautomatically extracting a lesion area. The extracted region of interestmay not only include a malignant lesion, but also a lesion area that isambiguous to be determined as malignant or benign, or a region with apeculiar feature.

Further, the region of interest extractor 110 may extract a region thatis marked by a doctor as being a suspected region when analyzing amedical image, i.e., the region of interest extractor 110 may extract aregion directly marked by a user as a region of interest.

The first medical image and the second medical image may be medicalimages obtained using diagnostic imaging devices such as, for example,an X-ray imaging device, an ultrasonic device, an MRI device, a CTdevice, and a PET device.

The second medical image may be an image of the same portion as aportion captured in the first medical image, and may be an imagecaptured before the first medical image. Further, the second medicalimage may not necessarily be a modality image identical to the firstmedical image, and if there is a plurality of second medical images,modalities of those second medical images may be different.

For example, it is assumed that there are three second medical images,in which the first medical image may be an ultrasonic image showing acurrent state of a patient, and the second medical image may be an X-rayimage captured six months earlier, an ultrasonic image captured sixmonths earlier, and an X-ray image captured immediately before the firstmedical image.

The region of interest merger 120 may register the first medical imageand the second medical image, and merge regions of interest of thesecond medical images into the first medical image. The imageregistration refers to a process of geometrically registering physicallysimilar regions in two or more different images captured at differentangles.

In an embodiment, the region of interest merger 120 merges regions ofinterest of the second medical images into the first medical image, suchthat a region of interest that is extracted from the second medicalimages may be merged into the first medical image.

The additional information determiner 130 may determine what additionalinformation is necessary for each of the merged regions of interest. Theadditional information refers to examination information orexamination-related information needed for accurately identifyingregions of interest to diagnose diseases. The additional information maybe divided into new additional information and previous additionalinformation.

The new additional information refers to information that is notacquired, collected, or stored in a medical database, such as, forexample, an electronic medical record (EMR) and a personal health record(PHR). The new additional information also refers to informationassociated with examinations that are needed for an accurate diagnosis.The previous additional information refers to examination information orexamination-related information that has been acquired, or collectedpreviously by various methods and stored in a medical database. Theprevious additional information is provided to a user for an accuratediagnosis. The additional information determiner 130 will be furtherdescribed with reference to FIG. 2.

The additional information provider 140 may provide a user withdetermination results obtained by the additional information determiner130. For example, the additional information provider 140 may provide auser the determination results of the additional information determiner130 through the display 150. The display 150 may display determinationresults of the additional information determiner 130.

FIG. 2 is a diagram illustrating an example of an additional informationdeterminer 130. Referring to FIG. 2, the additional informationdeterminer 130 includes a rule storage 131, a feature value extractor132, a rule retriever 133, and an additional information selector 134.

The rule storage 131 may store various rules that define feature valuesof regions of interest, and additional information needed for thefeature values. These rules may be pre-defined by a domain expert for avariety of situations. For example, for a breast cancer diagnosis, rulesmay be defined as shown in Table 1 below.

TABLE 1 Rules Feature values Additional information Rule 1Microcalcification X-ray images for the past one year are needed. Rule 2Malignancy of 40% to 60% Elastography images are needed. . . . . . . . ..

The feature value extractor 132 may extract feature values by analyzingprevious information on each of the merged regions of interest stored ina medical database. The previous information refers to examinationinformation or examination-related information previously obtained byvarious methods for regions of interest.

Feature values may be features of regions of interest that wereinitially extracted, such as, for example, shapes, margins, ultrasonicecho patterns of lesions in these regions of interest. The featurevalues may also be values obtained by calculation of the initiallyextracted regions of interest. In this case, the feature value may beexpressed in numbers or in labels, but is not limited thereto.

The rule retriever 133 may retrieve rules for feature values extractedby the feature value extractor 132 from the rule storage 131.

For example, the feature value extractor 132 extracts feature values“microcalcification” and “malignancy of 50%” from various images in aspecific region of interest that have been stored as previousinformation, the rule retriever 133 retrieves rule 1 for“microcalcification” and rule 2 for “malignancy of 50%” from the rulestorage 131 (see Table 1).

The additional information selector 134 may select additionalinformation for each region of interest from the extracted rules.

For example, if the extracted rules are rule 1 and rule 2, theadditional information selector 134 may select X-ray images for the pastone year and elastography images as additional information needed for aspecific region of interest (see Table 1).

FIG. 3 is a diagram illustrating another example of an apparatus forproviding additional information for each region of interest.

Referring to FIG. 3, an apparatus 300 for providing additionalinformation for each region of interest may include an image acquirer310 and an additional information acquirer 320 in addition to theconfiguration of the apparatus 100 for providing additional informationfor each region of interest.

The image acquirer 310 may acquire a first medical image and a secondmedical image. For example, the image acquirer 310 may acquire the firstmedical image and the second medical image from a medical database.Further, the image acquirer 310 may acquire the first medical image inreal time using an ultrasonic imaging device.

The additional information acquirer 320 may acquire additionalinformation determined by the additional information determiner 130 foreach region of interest.

If additional information determined by the additional informationdeterminer 130 for a specific region of interest is previous additionalinformation, the additional information acquirer 320 may acquire theadditional information by retrieving it from a medical database. Forexample, if the additional information determiner 130 determines thatX-ray images for the past one year are needed for a specific region ofinterest, the additional information acquirer 320 may retrieve X-rayimages captured six months and one week earlier from a medical databasefor, which are X-ray images for the past one year, among pre-storedexisting information.

If additional information determined by the additional informationdeterminer 130 to be required for a specific region of interest is newadditional information, the additional information acquirer 320 mayacquire the additional information according to a set informationacquisition mode. The information acquisition mode may include anautomatic acquisition mode that automatically changes an imaging mode ofan ultrasonic imaging device to acquire new additional information, andan interactive mode that changes an imaging mode of an ultrasonicimaging device according to a user instruction to acquire new additionalinformation.

As described above, the ultrasonic imaging device includes variousimaging modes, such as, for example, a bloodstream imaging mode, anelastography mode, a general ultrasonic mode, and a high-resolutionultrasonic imaging mode, and the additional information determiner 130determines that bloodstream images are needed as new additionalinformation for a specific region of interest. In the automaticacquisition mode, the additional information acquirer 320 may acquirebloodstream images in the region of interest by automatically changingan imaging mode of an ultrasonic imaging device to a bloodstream imagingmode. In the interactive mode, the additional information provider 140first transmits a message that a bloodstream image is needed for theregion of interest, i.e., a result that has been determined by theadditional information determiner 130, to a user through the display150. Then, if there is an instruction regarding the message, theadditional information acquirer 140 changes an imaging mode of anultrasonic imaging device to a bloodstream imaging mode to acquire abloodstream image of the region of interest. The additional informationprovider 140 provides additional information acquired by the additionalinformation acquirer 320 to a user through the display 150.

FIGS. 4A to 4C are diagrams illustrating examples of a process ofproviding additional information for each region of interest. FIG. 4A isa diagram illustrating an example of extracting regions of interest froma first medical image and second medical images. FIG. 4B is a diagramillustrating an example of merging regions of interest of second medicalimages into a first medical image. FIG. 4C is a diagram illustrating anexample of additional information for each region of interest.

Referring to FIG. 4A, a region of interest extractor 110 extractsregions of interest from each of a first medical image 410 and secondmedical images 421, 422, and 423. As illustrated in FIG. 4A, the firstmedical image 410 is a current ultrasonic breast image, the secondmedical image 421 is an X-ray breast image captured six months earlier,the second medical image 422 is an ultrasonic breast image captured sixmonths earlier, and the second medical image 423 is an X-ray breastimage captured a week earlier. The region of interest extractor 110extracts a region of interest 4211 from the second medical image 421, aregion of interest 4221 from the second medical image 422, a region ofinterest 4231 from the second medical image 423, and regions of interest4101 to 4103 from the first medical image 410.

Referring to FIG. 4B, the region of interest merger 120 registers thefirst medical image 410 and the second medical images 421 to 423. Theregion of interest merger 120 merges the regions of interest of thesecond medical images 421 to 423 into the first medical image 410. Asillustrated in FIG. 4B, the region of interest merger 120 merges theregion of interest 4211 of the second medical image 421 and the regionof interest 4231 of the second medical image 423 into the region ofinterest 4102 of the first medical image 410. The region of interestmerger 120 merges the region of interest 4221 of the second medicalimage 422 into the region of interest 4103 of the first medical image410.

Referring to FIG. 4C, the additional information determiner 130 extractsfeature values of each of the regions of interest 4101, 4102, and 4103merged into the first medical image 410, and determines what additionalinformation is needed for each of the regions of interest 4101, 4102,and 4103 based on the extracted feature values and pre-stored rules.

As illustrated in FIG. 4C, the region of interest 4101 is a region ofinterest that was not extracted from the second medical images 421 to423 captured before the first medical image 410, and exhibits a smalllesion. As the small lesion in the region of interest 4101 is ambiguousto be determined as malignant or benign, the additional informationdeterminer 130 determines that a high-resolution ultrasonic image and abloodstream image are needed for an accurate diagnosis.

The region of interest 4102 exhibits a feature of microcalcificationextracted by analyzing the second medical image 421, which is an X-rayimage captured six months earlier, and the second medical image 423,which is an X-ray image captured a week earlier, and a feature ofmalignancy of 50% extracted by analyzing the first medical image 410.Microcalcification in the region of interest 4102 shows that there is ahigh possibility of a breast cancer and more careful observation isneeded. The determination of the region of interest 4102 as malignant orbenign is ambiguous, which does not appear in the second medical image422, which is an ultrasonic image captured six months earlier, butappears in the first medical image 410, which is a current ultrasonicimage. Accordingly, the additional information determiner 130 determinesthat X-ray images captured six months earlier and a week earlier areneeded for an accurate diagnosis and to identify the microcalcificationprogression. Further, the additional information determiner 130determines that elastography images are needed, since currentinformation is not sufficient to determine whether the region ofinterest 4102 is malignant or benign.

The region of interest 4103 exhibits a feature of a benign tumor (e.g.,fibroadenoma) based on the analysis of the second medical image 422 thatis an ultrasonic image captured six months earlier and the first medicalimage 410 that is a current ultrasonic image. There is a need to checkwhether or not the size of such benign tumor has increased, because evenif it is not harmful to health, it is better to remove such benign tumorif it increases in size. Accordingly, the additional informationdeterminer 130 determines that an ultrasonic image captured six monthsearlier is needed for the region of interest 4103.

FIG. 5 is a diagram illustrating an example of providing a user withadditional information necessary for each region of interest.

Referring to FIG. 5, the additional information provider 140 summarizesfeature values or additional information for regions of interest 510,520, and 530 using various summarization methods in short sentences tocreate snippets 511, 521, and 531. The additional information provider140 displays the created snippets 511, 521, and 531 as a hyperlink atthe bottom of each of the regions of interest 510, 520, and 530. If auser clicks the snippet 521, the additional information provider 140provides additional information on the region of interest 520corresponding to the snippet 521 to a user through the display 150.

FIG. 5 illustrate an example in which snippets corresponding to eachregion of interest are displayed at the bottom thereof, but the positionof the snippets is not limited thereto, and the snippets may bedisplayed anywhere, such as, for example on the left or right, or at thetop or bottom of each region of interest, without departing from thespirit and scope of the illustrative examples described.

FIG. 6 is a diagram illustrating an example of a method for providingadditional information for each region of interest. The operations inFIG. 6 may be performed in the sequence and manner as shown, althoughthe order of some operations may be changed or some of the operationsomitted without departing from the spirit and scope of the illustrativeexamples described. Many of the operations shown in FIG. 6 may beperformed in parallel or concurrently. The above descriptions of FIGS.1-5, are also applicable to FIG. 6, and are incorporated herein byreference. Thus, the above description may not be repeated here.

Referring to FIG. 6, a method 600 for providing additional informationfor each region of interest includes extracting regions of interest(ROI) from each of a first medical image and second medical images in610. For example, the region of interest extractor 110 may extractregions of interest from medical images using an algorithm forautomatically extracting a lesion area, or a user may mark regions inmedical images that are to be extracted.

The first medical image and the second medical image may be medicalimages obtained by using an imaging device, such as, for example, an MRIdevice, a CT device, a PET device, and an X-ray device.

The second medical image may be an image of the same portion as aportion captured in the first medical image, and may be an imagecaptured before the first image. Further, the second medical image maynot necessarily be a modality image identical to the first medicalimage. If there are a plurality of second medical images, modalities ofthose second medical images may be different.

In 620, a region of interest of the second medical image is merged intothe first medical image. For example, the region of interest merger 120may register the first medical image and the second medical image, andmay merge a region of interest of the second medical image into thefirst medical image.

In 630, it is determined what additional information is required foreach of the merged regions of interest. For example, the additionalinformation determiner 130 may determine what additional information isrequired for each region of interest based on feature values of eachregion of interest and pre-stored rules.

The additional information refers to examination information orexamination-related information that is required for accuratelyidentifying regions of interest to diagnose diseases. The additionalinformation may be divided into new additional information and previousadditional information.

The new additional information refers to information that is notacquired, collected, or stored in a medical database, such as, forexample, an electronic medical record (EMR), a personal health record(PHR), and to information on or associated with examinations that arerequired to be further conducted for an accurate diagnosis. The previousadditional information refers to information required to be additionallyprovided for an accurate diagnosis among examination information orexamination-related information that has been acquired or collectedpreviously by various methods and stored in a medical database.

In 640, the determination results obtained in 630 may be provided to auser. For example, the additional information provider 140 may providedetermination results obtained by the additional information determiner130 to a user through the display 150.

According to an embodiment, the method 600 for providing additionalinformation for each region of interest may further include acquiring afirst medical image and a second medical image in 605. For example, theimage acquirer 310 may acquire a first medical image and a secondmedical image from a medical database. Further, the image acquirer 310may acquire a first medical image in real time by using an ultrasonicimaging device that includes the apparatus 300 for providing additionalinformation for each region of interest.

According to another embodiment, the method 600 for providing additionalinformation for each region of interest may further include, in 635,acquiring additional information determined that is to be required in630.

For example, if additional information determined by the additionalinformation determiner 130 to be required for identifying a specificregion of interest is previous additional information, the additionalinformation acquirer 320 may acquire the additional information byretrieving it from a medical database.

Further, if additional information determined by the additionalinformation determiner 130 to be required for identifying a specificregion of interest is new additional information, the additionalinformation acquirer 320 may acquire new additional informationaccording to an information acquisition mode. In this case, theinformation acquisition mode may include an automatic acquisition modethat automatically changes an imaging mode of an ultrasonic imagingdevice to acquire new additional information, and an interactive modethat changes an imaging mode of an ultrasonic imaging device accordingto a user instruction to acquire new additional information.

FIG. 7 is a diagram illustrating an example of determining additionalinformation necessary for each region of interest. The operations inFIG. 7 may be performed in the sequence and manner as shown, althoughthe order of some operations may be changed or some of the operationsomitted without departing from the spirit and scope of the illustrativeexamples described. Many of the operations shown in FIG. 7 may beperformed in parallel or concurrently. The above descriptions of FIGS.1-6, are also applicable to FIG. 7, and are incorporated herein byreference. Thus, the above description may not be repeated here.

Referring to FIG. 7, determining additional information for each regionof interest in 630 may first include analyzing previous information oneach of the merged regions of interest stored in a medical database toextract feature values in 710.

In 720, rules for the extracted feature values are retrieved frompre-stored rules.

In 730, additional information required for each region of interest isselected based on the extracted rules.

The apparatuses, components, and units described herein may beimplemented using hardware components. The hardware components mayinclude, for example, controllers, sensors, processors, generators,drivers, and other equivalent electronic components. The hardwarecomponents may be implemented using one or more general-purpose orspecial purpose computers, such as, for example, a processor, acontroller and an arithmetic logic unit, a digital signal processor, amicrocomputer, a field programmable array, a programmable logic unit, amicroprocessor or any other device capable of responding to andexecuting instructions in a defined manner. The hardware components mayrun an operating system (OS) and one or more software applications thatrun on the OS. The hardware components also may access, store,manipulate, process, and create data in response to execution of thesoftware. For purpose of simplicity, the description of a processingdevice is used as singular; however, one skilled in the art willappreciated that a processing device may include multiple processingelements and multiple types of processing elements. For example, ahardware component may include multiple processors or a processor and acontroller. In addition, different processing configurations arepossible, such parallel processors.

The processes, functions, and methods described above can be written asa computer program, a piece of code, an instruction, or some combinationthereof, for independently or collectively instructing or configuringthe processing device to operate as desired. Software and data may beembodied permanently or temporarily in any type of machine, component,physical or virtual equipment, computer storage medium or device that iscapable of providing instructions or data to or being interpreted by theprocessing device. The software also may be distributed over networkcoupled computer systems so that the software is stored and executed ina distributed fashion. In particular, the software and data may bestored by one or more non-transitory computer readable recordingmediums. The non-transitory computer readable recording medium mayinclude any data storage device that can store data that can bethereafter read by a computer system or processing device. Examples ofthe non-transitory computer readable recording medium include read-onlymemory (ROM), random-access memory (RAM), Compact Disc Read-only Memory(CD-ROMs), magnetic tapes, USBs, floppy disks, hard disks, opticalrecording media (e.g., CD-ROMs, or DVDs), and PC interfaces (e.g., PCI,PCI-express, Wi-Fi, etc.). In addition, functional programs, codes, andcode segments for accomplishing the example disclosed herein can beconstrued by programmers skilled in the art based on the flow diagramsand block diagrams of the figures and their corresponding descriptionsas provided herein.

While this disclosure includes specific examples, it will be apparent toone of ordinary skill in the art that various changes in form anddetails may be made in these examples without departing from the spiritand scope of the claims and their equivalents. The examples describedherein are to be considered in a descriptive sense only, and not forpurposes of limitation. Descriptions of features or aspects in eachexample are to be considered as being applicable to similar features oraspects in other examples. Suitable results may be achieved if thedescribed techniques are performed in a different order, and/or ifcomponents in a described system, architecture, device, or circuit arecombined in a different manner and/or replaced or supplemented by othercomponents or their equivalents. Therefore, the scope of the disclosureis defined not by the detailed description, but by the claims and theirequivalents, and all variations within the scope of the claims and theirequivalents are to be construed as being included in the disclosure.

What is claimed is:
 1. An apparatus for providing additional informationfor region of interest, the apparatus comprising: a memory configured tostore instructions; and at least one processor, upon executing thestored instructions, configured to: detect at least one region ofinterest from a first medical image, determine additional informationneeded for a diagnosis of each of the at least one region of interestdetected from the first medical image, and provide the determinedadditional information, wherein the determined additional informationcomprises examination-related information previously stored in a medicaldatabase.
 2. The apparatus of claim 1, further comprising: a displayconfigured to display the determined additional information.
 3. Theapparatus of claim 2, wherein the determined additional information isdisplayed as a hyperlink at a bottom of each of the regions of interest,and wherein the at least one processor is further configured to providethe determined additional information on the region of interestcorresponding to a hyperlink selected by a user through the display. 4.The apparatus of claim 1, wherein the at least one processor is furtherconfigured to: extract at least one region of interest from each of atleast one second medical image, wherein the at least one second medicalimage comprises one or more medical images captured prior to the firstmedical image, and merge the at least one region of interest extractedfrom each of the at least one second medical image into the firstmedical image.
 5. The apparatus of claim 2, wherein the first medicalimage and the at least one second medical image are captured bydifferent modalities.
 6. The apparatus of claim 2, wherein the at leastone second medical image comprises one or more images of a portionidentical to a portion captured by the first medical image.
 7. Theapparatus of claim 1, further comprising: a memory configured to storeat least one rule that defines feature values of regions of interest andat least one additional information required for the feature values. 8.The apparatus of claim 7, wherein the at least one processor is furtherconfigured to: extract a feature value of the at least one region ofinterest, retrieve at least one rule from the stored at least one rulebased on the extracted feature value, and determine the additionalinformation based on the retrieved at least one rule.
 9. The apparatusof claim 1, wherein the at least one processor is further configured toacquire the determined additional information.
 10. The apparatus ofclaim 9, wherein the apparatus is configured to be installed in anultrasonic imaging device comprising at least two imaging modes of: abloodstream imaging mode for obtaining a bloodstream image, anelastography mode for obtaining an elastography image, a generalultrasonic mode for obtaining a general ultrasonic mode, or ahigh-resolution ultrasonic mode for obtaining a high-resolutionultrasonic image.
 11. The apparatus of claim 10, wherein the at leastone processor is further configured to: acquire the determinedadditional information for each of the at least one region of interestby changing an imaging mode of the ultrasonic imaging device based onthe determined additional information, or control the display to displaya message for notifying a user of an imaging mode, needed to acquire thedetermined additional information, of the ultrasonic imaging device, andchange the imaging mode of the ultrasonic imaging device based on theuser's selection.
 12. The apparatus of claim 1, wherein the determinedadditional information further comprises: new additional informationthat refers to information associated with examinations to beadditionally conducted.
 13. A method for providing additionalinformation for region of interest, the method comprising: detecting atleast one region of interest from a first medical image; determiningadditional information needed for a diagnosis of each of the at leastone region of interest detected from the first medical image; andproviding, via a user interface, the determined additional information,wherein the determined additional information comprisesexamination-related information previously stored in a medical database.14. The method of claim 13, wherein the providing comprises: displayingthe determined additional information as a hyperlink at a bottom of eachof the regions of interest, and providing the determined additionalinformation on the region of interest corresponding to a hyperlinkselected by a user.
 15. The method of claim 13, further comprising:extracting at least one region of interest from each of at least onesecond medical image, wherein the at least one second medical imagecomprises a medical image captured before the first medical image; andmerging the at least one region of interest extracted from each of theat least one second medical image into the first medical image.
 16. Themethod of claim 15, wherein the first medical image and the at least onesecond medical image are captured by different modalities.
 17. Themethod of claim 13, wherein the determining the additional informationcomprises: extracting a feature value of each of the at least one regionof interest by analyzing information, stored in the medical database, oneach of the at least one region of interest; retrieving at least onerule from among one or more pre-stored rules based on the extractedfeature value; and determining the additional information based on theretrieved at least one rule.
 18. The method of claim 13, furthercomprising: acquiring the determined additional information for each ofthe at least one region of interest by changing an imaging mode of theultrasonic imaging device based on the determined additionalinformation, or controlling a display to display a message for notifyinga user of an imaging mode, needed to acquire the determined additionalinformation, of the ultrasonic imaging device, and changing the imagingmode of the ultrasonic imaging device based on the user's selection. 19.The method of claim 13, wherein the determined additional informationfurther comprises: new additional information that refers to informationassociated with examinations to be additionally conducted.
 20. Acomputer program product comprising a non-transitory computer-readablerecording medium having recorded thereon at least one program comprisingcommands, which when executed by a computer, performs a method, themethod comprising: detecting at least one region of interest from amedical image; determining additional information needed for a diagnosisof each of the at least region of interest detected from the medicalimage; and providing, via a user interface, the determined additionalinformation, wherein the determined additional information comprisesexamination-related information previously stored in a medical database.